I 



o 

ERIC 



I 



DOCOHENT RESUHE 



ED 052 358 



24 



VT ©13 482 



AUTHOR 

TITLE 

INSTITUTION 
SPONS AGENCY 

BUREAU NO 
POE DATE 
GRANT 
NOTE 



Schriver, William R. ; Bowlby, Roger L. 

An Analysis of Differential Benefits from Vocational 
Training. Final Report. 

Memphis State Univ., Tenn. 

National Center for Educational Research and 
Development (DHEW/CE) , Washington, D. C. 

BR-O-D-049 
Apr 71 

OEG-4- 70-0053 
87p. 



EDBS PRICE EDfiS Price MF-$0. 65 HC-53.29 

DESCRIPTORS Comparative Analysis, ♦Cost Effectiveness, 

♦Educational Benefits, Educationally Disadvantaged, 
♦Followup Studies, High School Graduates, Income, 
Statistical Analysis, ♦Student Characteristics, 
♦Vocational Education 



ABSTRACT 

The objectives of this study were to find out how 
the characteristics of students and their training affect the rate of 
return to investment in vocational training, how they affect the 
earnings of trainees, and how vocational training influences the 
distribution of income among educational groups. The data were 
collected in a previous study and consisted of detailed records for 
127 vocationally trained subjects and 127 individually matched 
untrained subjects. Records for 411 vocationally trained subjects 
were used for the analysis of earnings. The data were analyzed by 
analysis of covariance and multiple regression analysis. One strong 
relationship uncovered was the negative association between I.Q. and 
benefits from vocational training. Some conditions among former 
vocational students that were found to be related to relatively 
higher income potential were: (1) study in health occupations, (2) 
being of the male sex, (3) working at a job requiring specific 
training, and {4} being a high school graduate. It was found that 
training led tc similar proportionate income gains among the 
educationally deprived as well as high school graduates. <GEB) 
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ABSTRACT 



The labor force experience of a sample of former area voca- 
tional-technical school (AVTS) students was investigated to determine 

(a) the rate of return to AVTS training among various categories of 
students; (b) average income levels of various categories of students; 
(c) whether or not AVTS training tended to equalize expected income 
differences between dropouts and high school graduates. 

(a) The sample rate of return averaged 6.3 percent, was highest 
among those with low ability, those who received other related train- 
ing after AVTS departure, those married, and those receiving fifteen 
months or less training. 

(b) Average income (disregarding cost of training) was highest 
among those with health occupation training for females (males did 
not differ significantly with respect to type of training), among 
males, those working at skilled or semi-skilled jobs, those geograph- 
ically mobile, those married, and among high school graduates. 

(c) The administration of AVTS training to an educationally 
diverse sample tended to increase expected income of both dropout 
and graduate in ratio to expected earnings rather than by a constant 
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THE RESEARCH PROJECT: 



AN OVERVIEW 



1 . Objectives 

The objectives of the study were to answer the following three 
questions: (1) How do the characteristics of students and their train- 

ing affect the rate of return to investment in vocational training? (2) 
How do these characteristics affect the earnings of trainees? and (3) 

How does vocational training influence the distribution of income among 
educational groups? The student characteristics analyzed included sex, 
rural or urban residence, race, I.Q., marital status, age, relatedncss 
of occupation to training, and formal schooling. The training charac- 
teristics included type and length of training. 

2. Procedures 

The data examined were collected in an earlier study. They con- 
sisted of detailed records for 127 vocationally trained subjects and 127 
individually matched cohorts. In the analysis of earnings, records for 
411 vocationally trained subjects were available. Analysis of covariance 
was employed to estimate the specific effect of each individual factor 
upon the criterion (internal rate of return or earnings). Multiple re- 
gression analysis was used to test differences in the measured education- 
earnings curve of vocationally trained subjects and the comparable curve 
for the civilian labor force. 



3. Problem 



Vocational educators have competing goals. One is the narrow eco- 
nomic end of using scarce resources in such a way as to maximize the na- 
tional product. Others include such broad social goals as equality. 

The goals are liable to conflict at two points: selection and recruit- 

ment of students and decisions concerning the types of programs to be 
offered. Economic considerations may dictate the selection of the "best" 
students in terms of socio-economic status and formal education, while 
egalitarian considerations call for selection of the disadvantaged. Eco- 
nomic criteria may call for the selection of a training program to meet 
the needs of an expanding industry in a prosperous area, while there are 
egalitarian reasons for supporting a retrograde industry in a blighted 
area . 



Vocational education programs must compromise these objectives, 
and information about the differential benefits from vocational train- 
ing will be useful to planners in making this compromise. Whether bene- 
fits are higher for men or women, for long or short programs, or for 
typists or draftsmen cannot tell us who to train or what to teach him, 
but it is an important piece of information, and better decisions are 
likely to be made when more information is available. 



t 
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4. Questions to bo Answered 



(a) How do the characteristics of the trainee and the charac- 
teristics of his training affect the rate of return to investment in 
vocational training? Among the vocational school graduates for whom 
detailed char ac ter i.s tics are known, we can observe a gain of $590,223 
in increased projected lifetime earnings attributable to vocational 
training, and a loss of $1,109,214 for anothei* Individual in the group 
of graduates. For groups of students less influenced by individual 
cases, there are rates of return as high as 20.7 percent for students 
with I.Q.'s of 90 or less and negative returns for students with I.Q.'s 
of 111 or more. Since the high I.Q. students differ from tha low I.Q. 
students in sex, type, and length of vocational training, ui*ban or rural 
residence, and many other characteristics, it is necessary to use fairly 
sophisticated statistical techniques to isolate the influence of each 
factor. In addition to the characteristics already mentioned, it will 
be possible to answer question (a) in terms of race, marital status, and 
relatedness of present occupation to type of vocational training received. 

(b) How do the characteristics of the trainee and his training 
affect his earnings? This question differs from the first, for the in- 
fluence of each variable upon earnings will not be influenced by any 
cost factors. We might presume, for example, that high opportunity costs 
are responsible for the negative returns to students with high I.Q.'s, 
and that vocational training has a positive influence upon earnings even 
though it leads to negative returns on invested capital. The selection 
of income as the dependent variable also makes it possible to add two 
new characteristics to the list of independent variables, age and level 
of formal education. (Differential rates of return cannot be explained 
for these characteristics, since they were calculated for a group of 
matched pairs with the same age and formal schooling.) 

(c) Hot? do vocational training and formal education interact in 

determining the distribution of earnings? If education leads to increased 
earnings, there are a number of possible effects of superimposing voca- 
tional training upon a population with varying degrees of formal school- 
ing. The vocational training might equalize earnings, so that the highly 
educated lose all or most of their advantage, or it might benefit the 
educated student more than the dropout so that his relative income ad- 
vantage becomes even greater. In geometric terms, we can put the ques- 
tion this way: A graph of education and earnings for a population with- 

out vocational training will produce a positively sloped curve. If each 
member of the population is now given beneficial vocational training, 
does the curve become steeper, flatter, or negative, or does it simply 
shift to a higher level parallel to the original curve? This seems the 
most original of our questions, for we cannot find an attempt to answer 

it empirically in the existing literature. 
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5. Relationship to Other Research 



Many empirical studies have attempted to measure the benefits of 
investment in vocational training. 1 These studies have not often tried 
to isolate factors related to high and low rates of return. Borus and 
others found that males, high-school dropouts, and those remaining long- 
est in the program had the highest earnings gain from NYC training. ^ 
Rasmussen found that rates of return for OJT varied geographically, 
from zero in Portland, Oregon, to 167.4 percent in Miami. ^ 



Hardin has noted that ilures to consider trainee characteristics, 
different labor markets, and various kinds and durations of training 
programs constitute a common flaw in many existing studies. The present 
study is a step toward remedy of this shortcoming. 



As noted earlier, there is almost no hard evidence of the influence 
of vocational training on the established distribution of income by educa- 
tional levels. This question has a substantial literature of its own, 
with the works of Herman Miller among its best-known members, and it is 
hoped that the proposed research will make some contribution to knowledge 
in this area.-* 



6 . Procedure 



(a) Research method. Survey involving comparison of experimental 
and control groups. 

(b) Study subjects. The study population included 411 question- 
naire respondents among a random sample of students who attended Tennessee 
Area Vocational-Technical Schools before 1968 and had potential civilian 
labor force experience in 1968.^ The sample included substantial numbers 
of males and females, whites and Negroes, and rural and urban residents. 
Educational attainments ranged from one year of elementary school to 

four years of college, and measured I.Q.'s and high school grade point 
averages had a wide range. The occupational training periods at AVTS 
ranged from 3 months to 3 years, and the vocational courses pursued were 
health occupations, office occupations, drafting, mechanics and repair- 
men, cosmetology, machine shop, and welding. 

In addition to the 411 vocationally-trained subjects we had infor- 
mation concerning 127 untrained high-school graduates individually matched 
in a number of characteristics with certain of the trained subjects who 
were high school graduates, and were drawn from the same high school 
classes . ^ 

There was good reason to believe that the Tennessee Area Voca- 
tional-Technical Schools were quite similar to their counterparts in 
other states, since they were so new and all the schools were created by 
the same Federal enabling legislation. The range of characteristics in 
the study population was so wide that generalization to the entire group 

of non-collegiate high-school graduates appears to have face validity. 

* 
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(c) Data Analyzed. Between June 1, 1968, and January 31, 1970, 
the principal investigators conducted a cost-benefit study of training 
at Tennessee State Area Vocational-Technical Schools, sponsored by the 
University of Tennessee and the Tennessee State Division of Vocational- 
Technical Education. The data collected in that study were the basis 
for analysis in this study. 

The authors visited each of Tennessee's 19 Area Vocational -Tech- 
nical Schools (AVTS) and drew a 25 percent random sample of all former 
students. Information from school records was obtained on Form 1 shown 
in Appendix A for 1,701 former AVTS students. We attempted to form 334 
matched pairs by selecting the high-school graduates for the pros- 

pects of finding a match and work experience seemed best. The staff 
visited the high schools of graduation, and collected further informa- 
tion about the AVTS graduate and his classmates on Form 2 shown in Ap- 
pendix A. Further information was collected from the e>-AVTS students 
and their high-school classmates by a mailed questionnaire, Form 3 in 
Appendix A, for which an overall response rate of 70 percent obtained 
with a somcv;hat higher response rate for the AVTS students. In addiLion 
to the questionnaire information, individual social security authoriza- 
tions were received, and we obtained an earnings record for each subject 
from the Social Security Administration. 

The usable data available for analysis under Office of Education 
sponsorship included reasonably complete information for 411 former 
AVTS students and 127 we 11 -matched® pairs of trained and untrained 
graduates of the same high school class. We believe that these data 
were adequate to realize the objectives of the proposed study. 

7 . Summary of Findings9 

(a)^ An internal rate of return was computed for a sample of 
127 former area vocational-technical school (AVTS) students. Costs 
and benefits were obtained by matching each sample member with a cohort 
and determining their labor force experiences from responses to ques- 
tionnaires and examination of social security earnings records. 

The method of data collection, cohort matching procedure, and 
the computation of the rate of return should be useful to those con- 
templating similar investigations, but the most important aspect of 
the study involves a disaggregation of the rate of return by various 
student and program characteristics. An overall rate of return of 6.3 
percent was found. Analysis of covariance with Scheffe's significance 
test allowed the authors to examine the differential benefits. One of 
the stronger and more pronounced relationships uncovered through use 
of this technique was the negative association between I.Q. and benefits 
from vocational training. The category of former students with measured 
I.Q.'s of 90 and less earned the highest rate of return of all disag- 
gregated groupings (29.1 percent as compared to 5.9 percent for I.Q.'s 
of 91 to 110, and a negative return to I.Q.'s of 111 and over). 
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(b) H An internal comparison procedure was developed to analyze 
the effects of various student -re la ted and program-related characteristics 
on the potential income of former post-high school vocational students. 

The advantage of the methodology lies in its accuracy as a "follow- 
up" device for various training and educational programs. The methodology 
includes the use of a controlled and well-conceptualized method of data 
collection, use of potential income (rather than income) that offers some 
control on unemployment and participation rates, and a statistical design 
(analysis of covariance) that allows estimation of the effects of a spe- 
cific variable independently of covariatc influence. 

The following conditions among former vocational students v?cre found 
to be related to relatively higher potential income: study in health oc- 

cupations (among females) ; being of the male sex; working at a job that 
required specific training; migrating to another state; being married; 
being a high school graduate; receipt of only three to seven months of 
full-time vocational training (as opposed to greater amounts). 

1 9 

(c) Li Whether or not vocational training administered to an edu- 
cationally diverse group will increase the potential income of grade 
school graduates, high school dropouts, and high school graduates by a 
constant sum or in ratio to their expected earnings in the absence of 
vocational training is an important policy question. The propositions 
were tested to see which most accurately described the labor force ex- 
perience of an educationally heterogeneous group of former students in 
the Tennessee Area Vocational-Technical School system. The latter pro- 
position remained intact after two rigorous statistical tests. The slope 
of the income-education curve was not altered by the administration of 
vocational training, although there is strong evidence that there was 

an upward shift of the curve. 

From a policy standpoint, there is no reason to question this type 
of training as an anti-poverty device so long as poverty is conceptual- 
ized as j.ncome be lot; an absolute level. Training led to similar propor- 
tionate income gains among the educationally deprived as well as the 
high school graduates. However, the data and analysis do not evidence 
income redistribution from the educated to the uneducated as a result 
of vocational training. 



FOOTNOTES 



^Sec, for example , Michael Borus , The Eco n omic Kf fee tiveness of Retrainin g 
the Unemployed , Ph.D. dissertation, Yale, 1964; M. Borus , "Time Trends in 
the Benefits from Retraining in Connecticut," Proceed in gs of the In dust rial 
Relations Res car eh Ass o riati o n Meetings , Dec omb cr 1967; Arthur J. Coras?, ini , 
Vocational Educ e t icm , A Study of Ben efit s and Costs , U. S. Office of Educa- 
tion, 1966; Adger Carroll and Loren Ihncn, Cos ts and R e turns for Invest ments 
in Technical Sch ool ing , North Carolina State University, 1967; Max Eniger, 
The Pr oc ess and P rodu ct of Vocational Educatio n , Pittsburgh, 1965; J . J . 
Kaufman, E. W . Str orasdorf er , et a 1 . , An Analysis of Com par at i v c Cos t s and 
Benefits of Vocati o nal a nd Academic Educat ion ^Pennsylvania State University 
1967; Earl Man, "A Nation -wide Evaluation of MCTA Job Training," Journal of 
llumnn Resources , Spring 1968; D. A. Page, "Retraining Under the. MD1A: A 

Cost -Benefit Analysis," Public Poli cy, 1964; G. G. Somers and E. W. Stroms- 
dorfer, "Benefit-Cost Analysis of Manpower Retraining," Proc eedin gs of the 
Industrial Rela ti ons Research Associatio n Meetings, 1964; Michael Taussig, 

An Economic Ana lysis of Vocational Education in N c v7 York. City High Schools , 
Brookings institution, 1967; Daniel C. Rogers, Private. Rates of Return to 
Education in the United States , Ph.D. dissertation, Yale University, 1967; 
and Dale B. Rasmussen, De terminants of R ates of Return to Inves tment in On- 
the-Job Traini ng, Ph.D. dissertation, Southern Methodist University, 1968. 

^Michael E. Borus et al., "A Benefit-Cost Analysis of the Neighborhood Youth 
Corps," Journa l of Human Resources , Spring 1970. 

%abmusson, cited in note 1. 

^Einer Hardin, "Benefit-Cost Analysis of Occupational Training Programs: 

A Comparison of Recent Studies," North American Conference Proceed ings, 
Wisconsin, 1969. 

^Representative of these works is Herman P. Miller, "Annual and Lifetime 
Income in Relation to Education," American Economic Review , December 1960. 

6for a more complete description of the population and the process of drawing 
the sample, sec R. L. Bowlby and W. R. Schriver, "Nonwage Benefits of Voca- 
tional Training," Industrial and Labor Relations Review , July 1970. 

?Sce Bowlby and Schriver, op.cit . , for a more detailed description of the 
matching process. 

®The pairs are similar in all the characteristics listed in Appendix B. 

For a more complete description of the study design, see Bowlby and Schriver 
op. cit . 

^Each of the three questions raised in the beginning of this report is exam- 
ined separately in the three following manuscripts included as Appendices 
B, C, and D. The summary is taken from these detailed works. 



^See Appendix B. 
^See Appendix C. 
12 S ee Appendix D. 
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Form 1 



SCHOOLS 



1. 


Name of 


School 






2. 


Name 












(Last Name) 


(First Name) 


(Middle Name) 


3. 


Address 


(Last Known) 












(StreeL) 








(City) 




(State) 


4. 


Age 








5. 


Sex 


' 






6. 


Marital 


Status 






7. 


Date of 


Birth 










(Month) 


(Day) 


(Year) 


8. 


Parent or Guardian 






9. 


Address 


of Parent or Guardian 







10. Hours of Instruction Received (Total) _ 

11. Last Program in Which Enrolled 

12. GATE Scores; 

G ___ V H S P q K F M 

13. Performance in School; 

Above Average ______ Average Below Average 

14. Last Known Mailing Address 

15. Employer (Last Known) 

16. Reason for Leaving 
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Form 1 (Continued) 



17. 


Race 


18. 


Date of Entry 


19. 


Date of Exit 


20. 


Last School Attended 


il. 


Number of Years Completed 


22. 


Telephone Number 



eric 



lb 



Form 2 



FORM USED TO COLLECT DATA FROM HIGH SCHOOL RECORDS 

Experimental Control Control Control Control Control 
Subject #1 #2 #3 #4 #5 



Name 














Date of Birth 














Last Known Address 














Address of Parent or Guardian 














* 

Name of Parent or Guardian 














Father' s Occupation 




! 

! 








Sex 




l 


i 








Race 














Year of Graduation 














Grade Point Average 














I.Q* Score Test 














Rank in Class of 














Type of Program (Academic, Vocational or 
General ) 














College Attended (If any) 














Unusual Disciplinary Problems or Extra" 
curricular Activities 








i 
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Form 2 (Continued) 



Experimental Control Control Control Control 
Subject #6 #7 #8 #9 



Name 












Date of Birth 












Last Known Address 












Address of Parent or Guardian 












Name of Parent or Guardian 












Father' s Occupation 












Sex 












Race 












Year of Graduation 




— | 


j 






Grade Point Average 












I.Q. Score Test 












Rank in Class of 












Type of Program (Academic, Vocational or 
General) 












College Attended (If any) 












Unusual Disciplinary Problems or Extra- 
curricular Activities 













Form 3 



AT THE END OF THIS QUESTIONNAIRE THERE IS SPACE 
FOR YOUR COMMENTS AND OPINIONS 



1 . Name 

First Last 

2. Present Address _ _ 

Street or Route City State 

3. Do you now have a job? Are you a Veteran? 

No Yes No Yes 



IF YOU DID NOT HAVE ANY JOS DURING 1968, SKIP QUESTIONS 
4 AND 5 AND GO TO QUESTION 6 

4 

4. Please answer these questions about your present or most recent job. 

a. For whom do you work? 

(Name of Company, Business or Organization) 

b. What kind of business or industry is your employer in? 

(Such as: 



Shoe Factory, Grocery Store, Farm, Paper Mill, Bank, etc.) 

c. What kind of work are you doing? 

(Such as; Welding, Truck Driving 



Farming, Bookkeeping, Assembling, Machine Operator, etc.) 

d. Are you self-employed? If yes, how much do you 

No Yes 

earn (after business expenses) on the average per month? $ 

per mo. 

e. If you work for someone else, how much do you earn on the average 

before any deductions , counting overtime and incentive pay if you 

get it? $ _ __ per _ . 

hour, week, or month 

f. Were you out of work at any time during 1968? If 

No Yes 

yes, how many weeks were you out of work? Why? 



Weeks 



(Reason ) 



Form 3 (Continued) 



5. Have you done othei' kinds o£ work during 1968, different from your 

answer to Question 4(c)? If yes, what oLher kinds of 

No Yes 

work have you done? 

(Such ns: Welding, Truck Driver, Selling, 

Farming, Bookkeeping, Assembling, Machine Operator, etc.) 

flF~YOirANS VJ ERBD QUEST*! 0~NS~4 AMD 5, ^K IP 6 AND GO T0 7 j 
0. Why were you out of work during 1968? 



7. What is your present marital status? 

Married Single Other 

IF SINGLE ~PLEASE GO^TO QUESTION 8. IF MARRIED" 

OR OTHER , PLEASE ANSWER a AND b BELOW 

a. In what year were you married? 

Year 

b. If you have children at home, give year of birth of oldest child. 

” ~ Year ~ 

8. Have you ever taken any training or education programs for at least 

six weeks not counting high school? 

Yes No 

(Such as: college, junior college, technical institute, business col- 

lege, barber college, apprenticeship, area vocati onal-technical 
school., company training, Armed Forces school, correspondence schools, 
etc .) 

Kind of Program Began (Month & Year) Ended (Month & Year) 
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Form 3 (Continued) 



] 

* 

COMMENTS AND OPINIONS 



(Include whether or not you have been able to find work that suits your 
abilities and training, or anything else you want to tell us about your 
answers . ) 



i 
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THE DimEKKi i 



BENEFITS OF VOCATIONAL TRAINING 



In trod ucti on 



Vocational training involves two different allocation processes. In 
the first, society must determine the- share of its scarce productive capac- 
ity to be allocated to vocational training and necessarily denied to all 
competing claims. If the market solution for this problem is not accepted, 
which has been the case for more than a hundred years in the United States, 
public education comes into being arid gives rise to the second allocation 
problem; given limited resources available for devotion to vocational edu- 
cation, who should be trained, and wliat type of training „hould they re- 
ceive? 



Benefit- coat analysis and its variants have been widely applied by 
economists to the first problem. Marginal analysis suggests that expendi- 
tures for vocational education should be adjusted until their rate of re- 
turn reaches some rate not easy to specify representing opportunity costs. 
The present report makes some contribution to that literature, for it in- 
volves a computation of the rate of return to investment In vocational edu 
cation for a group of young people trained at Tennessee State Area Voca- 
tional-Technical Schools. This rate of return has a certain importance in 
its own right, and the methods used to compute it will be of interest to 
those conducting empirical research of this sort, while the results can be 
compared with rates of return computed by others for other sorts of educa- 
tion on other types of populations. 

The second problem has been less widely investigated. The benefits 
of education are in fact a function of at least three variables: the 

characteristics of the educational program, the characteristics of the 
students, and the characteristics of the environment into which the stu- 
dents graduate. Most published attempts to investigate the benefits of 
education have measured the joint effects of all these variables, so that 
no resolution of the second problem is possible. 

The main thesis of the present report is that the same sort of 
measurements appropriate to the resolution of the first question can also 
be used in attacking the second. Given limited student enrollments, we 
could expand or contract enrollment of boys and girls, whites and blacks, 
welders and typists, etc., in such a way as to maximize the social bene- 
fits from training resources if only we could measure the rate of return 
characterizing each sub-group of the trained population. For the labor 
force as a whole such a measurement is impossible because of the aggre- 
gation of the data. Detailed information for 254 individuals is the basis 
for the present analysis, which rests upon the assumption that this sample 
is reasonably typical of non-collegiate high school graduates. 
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The Data 



From June 1968 lo January 1970 the authors conducted a research 
project involving measurement of the rate of return to investment in 
training at all the 19 Area Vocal ional -Technical Schools (hereafter AV'i'S) 
then active in the State of Tennessee. Fach school kept complete' records 
of its former students; a 25 % random sample yielded 1,701 forme]' students. 
In measuring the rate of return, 1,367 of these students were eliminated 
arbitrarily for the; £ol loving reasons: (1) left AVTS too late to have 

labor force experience during all of 1968, (2) did not stay in AVTS for 
as many as 300 hours' of instruction, taken as the minimum necessary fnr 
acqnisition of marketable skills, (3) did not graduate from a Tennessee 
high school, (A) left school to enter college or military service, or (5) 
were born before 1943. The 334 subjects remaining, after these exclusions 
may be regarded as representative of the target population of non- 
collegiate, civilian Tennessee high school graduates. Since they repre- 
sent 19 different vocational training schools and more* Lhan 200 different 
high schools, a wide range of labor market conditions and characteristics 
arc 1 represented and it seems not unreasonable to hope that the. target 
population is fairly represented. 

The next step was an attempt to form 334 matched pairs by visiting 
the high school of each AVTS student and finding another member of the 
same graduating class with characteristics similar to those of the AVIS 
student. For 243 of the students it was possible to locate a high school 
classmate wi th the same race, sex and course of study (academic, voca- 
tional or general) and approximately the same age, grade- point average, 
and I.Q. An attempt to match father’s occupation by broad classification 
failed because the school records were incomplete (and often named em- 
ployers rather than occupations), but a few potential matches were re- 
jected when it could be established that they involved children of blue- 
collar and white-collar workers. 

A questionnaire was mailed to the 243 remaining students and one 
or more potential match for each. The questionnaire included a social 
security authorization form giving us access to earnings records of each 
student. While the overall response rate was 70 percent for the ques- 
tionnaires delivered to civilians, only 127 matched pairs resulted, since 
many of the subjects proved to be in military service, and a matched pair 
was lost whenever a subject or all his higli school classmates failed to 
respond, served in the military, or moved without leaving a forwarding 
address. 

The 127 matched pairs included 6? males and 65 females; 35 urban 
and 92 rural students, 114 whites and 13 black students, and a range of 
I.Q, scores and high school grade averages such that it appears to be 
reasonably typical of the non-col legiate high school group constituting 
the target population. The median period of training at AVTS was a little 
less than a year and the vocational courses pursued can be classified into 
seven groups: health occupations, office occupations, drafting, mechanics 

and repairmen, cosmetology, machine shop and welding. 
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Costs 



The cost of training for oach student was built up from four com- 
ponents: (1) public capital cost, (2) private capital cost, (3) public 

operating cost, and (A) opportunity cost* The method for estimating each 
cost can be discussed in detail. 



Public Capital Cost 

All the physical, facilities occupied by the schools were; built be- 
tween July 1, 19G3, and December 31 , 1 967, with public, funds. Land for 
the schools was donated by the counties in which they are located and is 
not included as a cost item, but with this exception we were able to 
measure all of the capital cost* Expenditure's at various dates, totalling 
almost $18 million, wore converted to dollars of July 1, 1963, by using a 
discount rate of 47., the assumed rate at which the State of Tennessee could 
have borrowed money during 1963. A useful life of twenty years was assumed 
for the buildings, so that the 4^ years in question were assigned 9/40 of 
the total cost. This sum was divided by the number of hours of AVTS train- 
ing received by all students during the study period to reach a capital 
cost of 69? pci' hour of instruction. This coefficient was multiplied by 
the hours of instruction received by each student to yield a personal cost 
for each individual. All this cost was presumed to be incurred during the 
quarter of first enrollment- Estimated cost for the. 127 students came to 
$112,246. 



Private Capital Cost 

Tuition was free during the study period at all schools, but some 
programs involved costs for boohs, supplies, uniforms and equipment. In 
some cases the cost varied from school to school in the same program, but 
the main variation (from a low of $5.30 to a high of $152.10) was among 
different types of programs. All this cost was charged to the quarter of 
first enrollment . 

The total for all 127 students was $5,033. No cost was charged for 
commuting to school, though we have enough cost data to know that it is an 
important cost item for most students, on the grounds that no deduction 
for commuting cost was made from the employment used as an opportunity 
cost, so that the opportunity cost computed here includes the cost of com- 
muting to work, which wc assume to equal the cost of commuting to school. 

Many of the students incurred negative costs in the form of train- 
ing allowance, most notably veteran's benefits. These should properly be 
deducted from private costs and added to public costs. This adjustment 
was not made because reliable cost figures were not available; while the 
adjustment would not alter our total rate of return, it would increase the 
private rate of return and depress the public rate. 




3-3 



Public O pe ro t i ti p, Co s L s 



These included all maintenance and operations at the local schools. 
Some administrative, expenses in Nashville appear to be missed because of 
tlic impossibility of separating out the overhead costs of an organisation 
(the Division of Voca Lionel -Techni cal Education) that has responsibilities 
at the secondary level as well rs for general supervision of Lho area 
schools, Tli is must be a minor item, and may be offset by the fnc.L that 
school facilities arc used without charge by a fee; civic groups such as 
boy scouL troops to whom it was not feasible to allocate any cost. The 
total cost was allocated to Lhe students, with division of total costs by 
total hours of instruction yielding a cost of $1.05 per hour of instruc- 
tion received. Again we obtained a personal cost for each individual stu- 
dent by multiplying this figure by his hours. This cost was spread evenly 
over the quarters in which Lhe student was enrolled. 



Opportuni ty Cost 

Since we had access to the social security record of each of our 
127 students and his match, we measured opportunity costs by subtracting 
earnings of the high school classmates from the earnings (if any) of the 
AVIS student for each calendar quarter during which he was enrolled in 
school. A good number of the AVTS students worked part-time while at 
school, and a few (to judge by their earnings records) must have been em- 
ployed virtually full-time. For 15 of the 127 students those costs were 
negative, and in two cases the negative costs were greater than the total 
of the. three cost items already discussed, so that for a tiny minority of 
our students, attendance at AVTS (as measured here) was at substantially 
zero cost. The group of 127 had costs of $173,339, and the range was from 
$7,750 for one individual to minus $2,862 for another. 



Benefits 

The benefit computation, like the calculation of opportunity cost, 
was based on a comparison bo L ween the two members of each matched pair, 
with the benefit defined as the algebraic difference between the earnings 
of the trained subject and his untrained high school classmate. 



Since the earliest students had about five years of actual or po- 
tential labor force experience and the latest students had only a year 
(calendar 1968), there was no single earnings base obviously suitable f 01 - 
all of the paired observations. Some experimentation with alternatives 
such as average quarter, high quarter and 196S average produced quite simi- 
lar results, and the figures here are all based upon high quarter earnings 
as the basis for measurement of benefits. The logic for using the high 
quarter for each individual is that it is the best measurement of earnings 
potential, and that vocational training can more reasonably bo hypothe- 
sized to increase earnings potential than to increase actual earnings. 

The figure so derived has the characteristic of minimizing the influence 
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of unempl oymoet, purl:- Li.uk' work, nrul non- par L i c i pal i on in the laboi force 1 , 
so ihnt: the rale: of return computed here will tend in mcusin'o. the primary 
influe'nco of training upon earnings via skill formation and neglect. the 
secondary influence;:* that may influence income* through those variables. 

The high quarter earning^ whenever they occurred, were attributeel 
to Lhe quarter following departure from AVTS, and the high quarter earnings 
of his matched cohort, whenever they occurred, were attributed to this 
same quarter. This gross earnings eli f for cnee was the. basis for the bene- 
fit computation; it was positive in 80 cases and negative in 47. Earnings 
growth was assumed for both members of the pair at the. rate of one percent 
per quartet (approximately the long-run gain in productivity for the* 
economy as a whole) until age 35, and stable earning, s were assumed there- 
after' until age 70 (for men) or GO (for women) . finally, joint probabili- 
ties of survival and labor force participation were computed at each age 
group for each sex, and them probabilities were multiplied by each com- 
puted benefit to discount the probabilities of death or non-participation. 

These assumptions produced a wide range of lifetime benefits. The 
largest gain was recorded by an AVTS sLudcnt with high quarter earnings 
of $2,942, or $226 per week, by comparison v/ith earnings of $1,521 in his 
own best quarter by the untrained cohort. This sLcdcat lias potential bene- 
fits of $590,223 during bis working life according to the stated assump- 
tions. At the other extreme was a sLudcnt v/ith $875 of high quarter in- 
come compared to $3,884 (the highest earnings figure in our study popula- 
tion) by liis untrained high school classmate. Our assumptions applied to 
tli is case indicate; a potential lifetime loss of $1,109,214 attributable to 
school attendance. 

A wide variety of benefit assompti ana concerning the projected ex- 
periences of these relatively young people over their lifetimes could, of 
course, be made, and each new assumption would produce a different rate 
of return. The particular assumptions made here can be defended as being 
reasonable, if not as "correct" or "exact" in any sense, and even substan- 
tial departures from these assumptions, though they would si gni f i cantly 
raise or lower the. computed rate of return, would probably not change the 
relationships among the rates of return for such sub-groups as males and 
females or weldors and draftsmen as long as they are based on the sane 
earnings difference, positive or n V ative, between each AVTS graduate and 
his high school classtMt* of equal ability. 



Results: Rates of Return 

Given a set of cost and benefit figures, the internal rate of return 
can be defined as the unique rate that makes the present value of benefits 
exactly equal to the present value of costs. Since each benefit and each 
cost can be identi fled v:i t h a particular calendar quarter, mathematic ex- 
pression of the rate of return will be simplified by numbering the 285 
quarters from the third quarter of 19G3 (the first quarter in which any 
costs were incurred) through the third quarter of 2034 (the last quarter 
in which any of the- 127 subjects can possibly be on the fumy side of 70), 
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consecutively. The rale can thru be expressed ns Uie value of r which 
solves Llic equation 




r’C^j) + C 2 (i) -I- 03(1) H- c 4 (j) 




B(0 



0 + r) 1 



(1 -I- r) 



where C] , C3, and are the four cost ileus identified ee.rlur, B 



is the benefit figure, and each i is a calendar quarter, so that r is the 
only unknown. A modified rate including only the Lwo la L ter' cosi. figures 
(and consequently aheays higher) can be identified as the private rate of 



data that make the total rate of return rave reliable than the private.: one. 

A rate of return to the government is' not calculable 1 , for there is no 
measurement for governmental benefits. No doubt such governmental benefits 
as higher tax collections (which of course lower' private benefits dollar 
for dollar) and lower' rates of incarceration, unemployment, and welfare 
costs (which load to incx*cnseJ private benefits) Lake place, and no doubt 
the multiplier effect oi higher incomes for the' trained population diffuse 
benefits throughout the economy, so that the raLc-s of return computed here 
may be judged as conserve ti.vc . Again, it scorns probable that different 
a ssutnp t i oi'ts v/ou Id produce a higher ra t e of r e L u rn but. would h nvc little 
influence upon the differential rates of return that are the primary con- 
cern of tin's report. 

Table I shows the internal rates of return, total and private, for 
the 127 matched pairs and some of the more important sub-groups of the 
population. It. indicates an overall rate of 6.3 percent fox' the 127 matched 
pairs, with higher rates for females, workers who moved, following training 
and worked in jobs related to their training, rural youth, whites, students 
with low I.Q.’s, and students vi th occupational specialties in welding, 
mechanics, machine shop and office occupations. 



questions posed initially, there is another souse in which they raise as 
many questions as they answer, for they do not show interaction among the 
vax*iablcs. The high rate of return for students with low I.Q. and the low 
rates for high I.Q. students, to take a more or less random example, might 
be caused entirely by a concentration of low I.Q. students in the machine 
shop program and high I.Q. in drafting. I.Q. as such could conceivably 
have nothing to do with the rate of return; the argument could be inverted 
to show that the computed rates are consistent with a situation in which 
the type of program has nothing to do v.u th rates of return, but I.Q. is 
all important. By extension, it is also possible that neither I.Q. nor 
types of program arc really important, but that yet another factor (per- 
haps hours of instruction in AVIS) determines the differential benefits of 
vocational training. 




Analysis of Variations 



While there is a sense in which the data In Table I answer th 
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Table 1 



INTERNAL RA'i ES OF RETURN 



Perc ent: Kate of Ret urn 



Number o£ 


Pairs 


Total 


Private, 


3 27 


All subjects 


6.3 


13.4 


62 


Mules 


2.3 


5.9 


65 


Females j 

Without geographic mobility 


10.0 


26.5 


109 


3.2 


7.1 


18 


Geographical ly mobile^ 


19.5 


...a 


35 


Urban 


__b 




92 


Rural 


8.6 


16.5 


114 


White 


6.9 


14.3 


13 


Negro 




1.3 


20 


Low (90 or less) T.Q. 


29.1 


73.6 


65 


Medium (91-110) l.Q. 


5.9 


12.0 


23 


High (111 and over) l.Q. 


„..b 


__ b 


82 


Placed in jobs related to 
training 


8.5 


16. 1 
i 


42 


In unrelated jobs 


„_b 




17 


Drafting students 


__b 


b 


11 


Welding students 


9.0 




22 


Mechanics and repairmen 


10.7 


20.0 


11 


Machine shop students 


14.7 


27.2 


20 


Health occupations 


0.8 


4.3 


46 


Office occupations 


11.2 


27.7 



Still lived in counLy o£ high school graduation or adjacent county. 

2 

Moved more than one county away from county containing high school 
of graduation. 

Si 

More than 308 percent (Loo high to compute), 
b 

Negative benefits (no return calculable). 

c 

Positive benefits, but less than costs (no return calculable). 
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The analysis of covariance i an appropriate statistical technique 
for the resolution of these* conflicting claims. In principle this analysis 
permits us to hold all other things (covariates) constant, and consider the 
cause, and effect relationship between a cause (file tor) and a result (cri- 
terion). In terms of the proceeding discussion, we need to select a cri- 
terion for judgment (the rate of return on costs), select a hypothetical 
causal agent, or factor (l.Q.) influencing the criterion, and measure the 
relationship between the factor and criterion while holding the covariatcs 
(type of program and hours of instruction) constant. As soon as this 
analysis is completed, we could select type of program as the factor and 
l.Q. and hours of instruction as covariatcs and complete our analysis of 
variance by selecting hours of instruction as the factor and l.Q. and type 
of program as the covariates. If the true causative ageut(s) have been 
captured in our data, this process will ultimately make it possible to 
identify them. 



The Crit eria 

For the group of 127 matched pairs, the appiopriato criterion, or 
result to he explained, is the rate of return shown in Table I. Since 
cacli of the 127 pairs embodies a different combination of factors and co- 
variates, it is necessary to measure the level of the criterion variable 
in each of the 127 observations. No rate of return can be computed for 
the 40 individuals who fa i. led to experience any returns, and the rate 
computation is impossible even for some of the population sub-groups shown 
in Table I. 

Since a rate of return cannot be computed for each, paired student, 
it is necessary to select a proxy variable that measures as closely as 
possible the contribution of each individual to the rate of return for the 
group. The first proxy, which can be designated as the gross income dif- 
ference, is simply the algebraic difference between the high quarter earn- 
ings of the AVTS student and those of his untrained schoolmate. As noted 
earlier, this figure has a range from $1,421 to minus $3,009. 

The gross income difference is logically objectionable as a proxy 
variable because it is not influenced by the cost of training. A second 
proxy, which can be designated as the net income difference, is derived by 
multiplying the gross difference by 45.5 and subtracting total costs. The 
constant multiplier is selected because the mean, student required 45.5 
calendar quarters of higher income in order to recoup the total cost, pub- 
lic and private, of his education. It can be added as a matter of in- 
terest that the mean student required 17.7 quarters to recover his personal 
costs as they are measured here. 

These criteria represent an approximation of the contribution of 
each matched pair, and as will be scon shortly, the choice between them is 
of comparatively little concern as they are explained by essentially the 
same factors. The first criterion has the virtue of being easy to under- 
stand and interpret, while the second measure' has the incidental advantage 
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of a zero moan so that above-average or helov-averagc figures can bo easily 
determined by Inspection of the sign. 



The Factors and Covariates 



Data are available to examine 12 variables as possible causative 
agents explaining the level of the criterion measure. Each, in turn, can 
be permitted to vary as a factor while the others are held constant as 
covariates through the statistical technique of analysis of covariance. 

# Tahle II exhibits the factors and shows the levels of the two criteria 
bo Lb raw and adjusted for covariation. 

Type of program is shown as the first factor. The adjustment for 
covariation produces a number of changes in the rankings, but none of the 
differences, notably the difference between drafting and machine shop which 
amounts to more than $22 per week, can be determined to be statistically 
significant at the five percenL level perhaps because of the small number 
of observations and the high standard deviation of the groups. 

Sex appears as the second factor, and it is notable that the sub- 
stantial sex differential appearing in the raw data and in Table 1 is al- 
most completely removed by the adjustment process. This must be inter- 
preted as an indication that the high differential benefits for females 
are apparent and not real, and that they are explained by factors other 
than sex. 



Place of residence is determined by the high school attended by the 
pair. This variable fails to produce any statistically significant re- 
sults, though it does produce a rather striking reversal of ranks. The 
same holds true for racial differences. 

The first statistically significant findings come when the fifth 
variable, relatedness, is selected as the facLor. The classification is 
based upon a comparison between the occupation listed by the AVTS student 
at the time he completed the questionnaire and his occupational goal as 
listed in school records; it is not influenced by the occupation of the 
untrained cohort. The conclusion that placement in a related occupation 
leads to a higher rate of return is not unexpected. 

Occupational mobility is defined in tortus of job changes by the AVTS 
student, and is not influenced by the occupacional mobility of the cohort. 
Differences "among the three mobility groupings are not significant. 

A number of the AVTS students had received other post secondary 
education in addition to AVTS. Like relatedness and mobility, the clas- 
sification of pairs into the six groups exhibited in Table II was made on 
the basis of training received by the AVTS students without regard to the 
training experiences of the cohorts. "Long" and "short" are separated by 
300 hours or three months of instruction, the same minimum requirement se 
for AVTS attendance. Two of the comparisons here are significant: at the 
five percent confidence level. 
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Table II 



RATES OF RETURN FOR SELECTED GROUPS, WITH ADJUSTMENTS FOR COVARIATES 







Gross Returns (Dol- 


Net Returns (Dollars 




* 


lars Per 


Quarter) 


Per 45.5 


Quarters) 


Basis f 


or Group Classification and Number in Group 


Unadjusted 


Adjusted 


Unadjusted 


Adjusted 


Classification bv Type of Program 










17 


Drafting Students 


-$131 


-$ 35 


-$10,687 


-$ 5,978 


11 


Welding Students 


33 


92 


- 1,164 


1,315 


46 


Office Occupations 


123 


35 


3,244 


- 1,691 


22 


Mechanics and Repairmen 


99 


176 


509 


3,838 


11 


Machine Shop 


200 


260 


3,790 


7,796 


20 


Health Occupations 


97 


68 


383 


261 


Classification by Sex 










62 


Males 


16 


S8 


- 3,423 


6 


65 


Females 


140 


71 


3,265 


6 


Classif 


ication by Residence 










35 


Ur ban 


85 


96 


- 64 


1,334 


92 


Rural 


77 


73 


24 


- 508 


Classification by Race 










114 


Whites 


77 


81 


143 


43 


13 


Negroes 


103 


71 


1,250 


377 


Classification by Relatedness of AVTS Training to Current 


Occupation 


179 H 






72 


Same Occupation Trained For 


153 


2,824 


4 , 269“ 


9 


Occupation Related to Training 


0 


- 99 l 


- 4,044 


- 8,650 L 


13 


Unrelated Occupation 


239 


212 


10,529 


6, 361 


33 


No Training Required 


- 142 


- 14 1 L 


9,208 


- 9,5A1 l 
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Table II (Continued) 



Basis : 


for Group Classification and Number in Group 


Cross Returns (Dol- 
lars Per Quarter) 
Unadjusted Adjusted 


Net Returns (Dollars 
Per 45.5 Quarters) 
Unadjus ted Adjusted 


Class! 


fication by Occupational Mobility 










84 


No Changes 


$ 61 


$ 57 


-$ 1,096 


-$ 1,097 


16 


Change to Another Occupation in Same Croup 


156 


134 


4,367 


2,565 


27 


Change to Different Croup, e.g., Semi-Skilled 












to Skilled 


91 


118 


820 


1,893 


Classification by Receipt of Training in Addition to AVTS 








j 


98 


No Additional Training 


52 


51 L 


- 1,239 


- 1,418" 


7 


Short, Unrelated Training 


- 118 


- 91 


- 9,178 


- 7.057 


11 


Short, Related Training 


320 


30 8 h 


11,580 


10, 901" 


5 


One Year or More of College 


- 11 


- 34 


- 5,114 


- 5,456 


1 


Long, Unrelated Training 


66 


5 


899 


- 3,695 


5 


Long, Related Training 


467 


505 h 


16,945 


19,8S1 H 


Classification by Geographic Mobility 










109 


No Mobility 


65 


72 


599 


310 


8 


Mobility Xithin Tennessee 


IS 


39 


- 3,97/ 


- 1,965 


10 


Interstate Mobility 


283 


190 


9,710 


4,9A7 


Classification bv Marital Status 








M 


81 


Married 


134 


122 


2,657 


2, 102" 


46 


Other Marital Status 


- 16 


5 


- A, 679 


- 3,702 L 



Classification by I.Q, Score 



21 


Less Than 91 


282 


323" 


9,196 


10, 993'* 


82 


91-110 


50 


64^ 


- 1,532 


572^ 


24 


111 and Over 


5 


- Si L 


- 2,813 


- 7,665~' 
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Table II (Continued) 



Basis for Group Classification and Number in Group 



Gross Returns (Dol- Net Returns (Dollars 
lars Per Quarter) Per 45.5 Quarters) 

Unadjusted Adjusted Unadjusted Adjusted 



GO 






C lassification by Age 



29 


Born After 1948 


$ 77 


$ 67 


$ 671 


-$ 701 


98 


Born 1948 or Earlier 


80 


83 


199 


207 


Class if ic 


ation by Hours of AVTS Instruction Received 




159 h 






33 


300-699 Hours 


124 


4,310 


5,810; 


30 


700-1,099 Hours 


103 


182 h 


1,990 


5,626 


21 


1,100-1,499 Hours 


179 


193 

"T 


4,433 


5,190. 


9 


1,500-1,899 Hours 


- 272 


- 242^ 


- 18,047 


- 16,316: 


34 


1,900 Hours and Over 


48 


- 73 L 


- 3,899 


- 9,490 


H - Signi 


ficantly higher (at the 57* confidence interval) 


than the group 


marked L 


in the same 


classifi- 



H 

H 

L 

L 



cation. 



L - Significantly lower (at the 5% confidence interval) than the group marked H in the same classifi- 
cation . 



o 



Geographic mobility (with the. movement of the AVTS student, as 
usual, controlling the. classification of the pair) affords another in- 
teresting case of the limitations of computations of the sort shown in 
Table 1, for the adjustment for covariation narrows the spread between 
movers so that it can no longer be demonstrated as statistically signifi- 
cant. Again the difference is considerable in dollar terms, and it sc.cms 
likely that only a higher number of movers would be required to demon- 
strate statistical significance* 

The difference between marital status remains substantially un- 
changed by the statistical adjustment, and is statistically :;igni f i cant. 
Much the same analysis can be made of the I.Q. classification, the statis- 
tical adjustments only serve to confirm the cruder rates of return com- 
puted without adjustments, and reported in Tabic I. Differences between 
the. two age groups seem unimportant, either with or without adjustments. 

The last classification pinpoints the hours of instruction received 
at the AVTS as a factor. It shows significantly higher rates of return for 
the short-term school attcndcr. This result is less surprising if the na- 
ture of instruction at the schools is understood. All teaching is individ- 
ualized, and the student is encouraged to learn at his own speed and leave 
as soon as he becomes employable. It follows that the most highly mo- 
tivated and capable students are found among the short-term at tenders. 



Conclusion 

The feasibility of calculating differential rates of return has been 
demonstrated by this report, and a number of differentials have been cal- 
culated with considerable statistical rigor. While many of the figures 
could be the subject of diverse interpretations, and further data collec- 
tion might be considered prerequisite to firm conclusions, the information 
presented here is worth consideration by policy makers, and it seems' likely 
that it could be used to increase the rate of return flowing from a given 
volume of dollar expenditures. 
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INCOME DIFFERENCES AMONG VOCATIONAL TRAINEES: 
A PROCEDURE FOR INTERNAL COMPARISONS 
KITH SELECTED FINDINGS 



The economics of vocational education have received widespread 
attention from economists, educators, and manpower planners during the 
past decade. Among economists, this renewed interest in the economics 
of education can be dated by the now classic work of T. W. Schultz. ^ 

The principal research efforts of economists in this area have been the 
computation of benefit-cost ratios and rates of return for investments 
in educat^on.^ These studies have been extremely useful in the. evalua- 
tion of social and private benefits of vocational training, but they 
have usually failed to pro.ide information directly trims la table into 
curriculum planning, student selection, or other day-to-day educational 
problems. If economic studies of vocational education arc to be useful 
in the efficient allocation of- resources among curricula, categories of 
students and types of programs, then future studies must go beyond the 
.mere justification of broad educational systems. 



Too often, the economic studies have not isolated the effects of 
specific curricula on benefits nor the relationship of various student 
characteristics to benefits. Although Rasmussen^ feund that benefits of 
vocational education vary with city size and industrial mix and Borus 4 
found that male high school dropouts received relatively greater bene- 
fits from post high school vocational education than females or high 
school graduates, little else in the economics of education has been 
reported that demonstrates contrasts in benefits. 



Another criticism of these economic studies, in terms of failure 
to provide specific program and curriculum guidelines, centers on the 
concept of "benefit." Benefits are the excess of expected lifetime 
income streams over cost streams usually discounted to present value 
at some arbitrary rate. Not only are capital and operating costs con- 
sidered but trainee opportunity costs as well. It is difficult to deter- 
mine what a trainee would have earned while undergoing training or what 
he would have earned without training. The economist is frequently forced 
to rely upon estimation by aggregation and disaggregation of published 
statistical data or poorly matched control groups that frequently amount 
to little more than crude measurement of training effects. Then too, 
assumptions concerning discount rates and expected lifetime income 
streams may override the direct effects of education. 



If economic evaluation of vocational education has tended to be 
too abstract and general, evaluation by educators may be even more de- 
ficient. Sharp and Krasnegor^ in their survey of follow-up studies c£ 
vocational education point out that the validity of follow-up methods 
is dependent upon appropriate and random samples, control of non-response 
bias, and the application of appropriate statistical and analytical tech- 
niques. Most of the studies summarized by them appeared to bo of but 
limited value to education 0 ! planning. Not only an- sample design and 
response bias open to serious question in many cases, but the variables 
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used to evaluate the programs and their measurement are subject; to great 
difficulties in interpretation. Frequently, former students were asked 
to evaluate their training, their attitude Lova.rd jobs, or to describe 
their posL-training labor force experience. 

Waruibrod® summarized the problem by stating, "Research conducted 
by vocational educators relating. . .to the economic value of vocational- 
technical education has been primarily descriptive rather than analy- 
tical. Research conducted by economists. . .has been limited in scope • 
and concept, particularly in the identification amd measurement: of the 
benefits of vocational- technical education." 

In 1968 the authors undertook an investigation of the rate of 
return to a statewide system of vocational-technical schools. In addi- 
tion to Lhis more general analysis, an attempt was made to develop a 
follow-up procedure and an analytic technique that would allow specific 
program evaluation. Data obtained in tliat study are the basis for this 
artic lc . 



Study Population and Data Collection 



Fr om files containing the records of all former Tennessee Area 
Vocational-Technical School fAVTS) studenLs, a one- in- four random sample 
of 1,701 subjects was drawn. Rejecting students for the following 
reasons led to a reduced sample of 587: (a) less than three months 

AVTS attendance; (b) recorded physical, behavioral, or psychological 
disabilities; (c) left AVTS to join armed forces or attend college; and 
(d) left AVTS later than December 31, 1967. Biographic data and training 
data were obtained from AVTS records. Each former student was then sent 
a questionnaire in February 1969 requesting detailed labor force experi- 
ence in 1968 and authorization for the release of their Social Security 
income account.® Each questionnaire was accompanied by fifLy cents as 
payment for service rendered. A 70 percent response rate was obtained, 
resulting in a net sample of 411. A test of differences between respond- 
ents and nonrespondents revealed no -significant differences, except 
under'-representation of males (and male-related programs) due to a high 
rate of military service and consequent disqualification. This bias is 
statistically removed by controlling on sex. 



Rather than relying upon income reported by the respondent, meas- 
urement was improved by contracting with the Social Security Administration 
to provide quarterly income account records for sample members on Lhe basis 
of signed authorization cards. ^ It is a wel 1 known phenomenon that indi- 
viduals respond unpredic tably to questions about income even when the 
questions arc clear as to types of income and meLliod of computation. 



Social Security records offer an advantage in that all persons in 
covered employment (98 percent of the net sample) are, required by lav to 
pay a tax on a fixed earnings base, and as long as the individual earns 
less than the base, his earned income by quarter is directly obtainable 
from Social Security records. For a few subjects, annual incO' e exceeded 
th e we ge ba s £ * , and c ove red o a r u i n g s c ou Id be d e t f n m i no d with c omp 1 e t e 
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accuracy only fox' llic first two or three calendar quarters of the year. 
Earnings estimates for members in uncovered employment (app rosinui l ely 
2 percent), such as railroads and certain federal and state employment, 
were made from responses to wage rate items included in the questionnaire 
when the responses v;ere clear and unambiguous. 

For this study "potential earned income" (hereinafter income) was 
computed by selecting fox' each subject the quarter of highest earnings 
between departure from AVIS and the last quarter of 19G8 inclusive. (The 
earliest AVI’S departure date was in 1963, but all. members had at least 
four potential quarters of civilian labor force experience.) This can 
reasonably be taken as an index of a worker's earning capacity, and 
quarters of lov?er earnings can be rejected on the assumption that the 
worker was below capacity. This assumption w 111 tend to eliminate income 
distortions due to low participation, unemployment , child bearing, labor 
disputes, illness, accidents, etc.*^ Logical support lor this approach 
rests in the idea that vocational education increases the individual's 
earning capacity, and this potential is a more legitimate measure of the 
income effect of education than actual earnings during a limited time 
interval. 



Analysis 

The purpose of the analysis presented here is to distinguish among 
levels of income associated with specific student and training program 
characteristics. However, it is not satisfactory merely to compare the 
income of certain categories of vocationally trained workers with others, 
for observed income diffei'enccs could be attributable to the interaction 
of other and uncontrolled variables. For example, if it were found that 
students trained in machine shop earned on the average $3,000 more annually 
than did students trained in health occupations, the income difference 
could be attributable to compositional differences with respect to sex, 

IQ, hours of instruction, or level of prior' educational attainment. In 
order to remove this source of error, a more sophisticated statistical 
model must be employed. 

* 

An analysis of covariance model was selected that allows computa- 
tion .and removal of the interaction effects of covariatcs and provides 
estimates of the adjusted treatment means of the criterion at predeter- 
mined levels of a single factor. Using the example above, income is 
the criterion; sex, IQ, hours of instruction, and level of prior educa- 
tional attainment arc co variates; machine shop and health occupations 
are the two levels (treatments) of the factor "type of program." The 
effect of the computations specified in the analysis of covariance model 
is to hold all the covariatcs constant and estimate the mean of the cri- 
terion for each level (treatment) of the factor. If the $3,000 difference 
remains after these adjustments, it represents a true contrast between 
machine shop and health occupations. If it disappears as a result of the 
computations, the observed difference is spurious and results from dif- 
ferences in the covariatcs, not in the type of program. Although unad- 
justed factor means are also shown in the subsequent tables, the adjusted 
treat me n t me a n e s 1 1 m a t e s are u so d o x c 1 u s i v c 1 v i n the an a 1 v s is. Stalls- 
tical significance v,-as estimated by Schqffe’s test. J 
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For each of the 411 students data uorc ro cor clod, in addition to 
the income criterion, on the following variables: (1) instructional 

program, (2) hours of instruction, (3) sex, (4) level of prior educa- 
tional attainment, (5) age, (G) TQ, (7) race, (8) relatedness of in- 
structional area to present occupation, (9) post-AVTS training or edu- 
cation, (10) geographic mobil it y , (11) oc cupational mobility , (12) rural - 
urban residence, and (13) marital status. The model treated each of the 
above variables separately as factors with the icnaining twelve variables 
entered into the equations as covariates. Table 1 shows the various 
levels into which the fourteen factor's were subdivided. 



A cav eat must be stated concerning the legitimate inferences that 
may be drawn from the analyses subsequently presented. The reader is 
cautioned not to infer cause-effect relationships between vocational 
training and any of the variables analyzed. Although the authors have 
attempted to do so in anocher paper, suffice here to say that one is 
limited to the inferences that compare income experiences of categories 
of trainees against other categories of trainees. Since this model 
does not compare the vocationally trained against a similar non- trained 
control group, cause-effect relationships cannot be examined. 

The usefulness of the internal comparison procedure and findings 
presented here lies in their rather straightforward estimation of average 
potential income rates attained by former students described by the 
variable under consideration. These income ranks (adjusted mean income) 
may be used to evaluate certain student and program characteristics as 
they relate to income potential. Thus, it is the relative ordinal (and 
interval) rank of a specific treatment level in the criterion hierarchy 
within a category LhaL estimates how students possessing that attribute 
(the specific treatment) fared in the labor force. This technique allows 
program planners to evaluate expected income levels associated with numer- 
ous variables. This is not to say that the income levels are causa lly 
related to the program or student variables to be examined in the fol lowing 
tables, but that, given labor supply and demand functions existing at the 
time and place under study, these income results obtained. 

For example. Tabic 2 shows no significant differences in adjusted 
mean income among the various male instructional programs. 15 The program 
planners would likely conclude Chat there is no apparent reason to curtail 
or expand a specific program on the basis of data presented in this table. 
As stated previously, although unadjusted (for covariate influence) income 
is shown for each level, only adjusted income is used in the analysis. 

Male and female pregrams arc analyzed separately since each program was 
mutually exclusive with regard to sex. When statistical adjustments were 
made for differences in IQ, age, mobility, etc., the estimates of adjusted 
income were not significantly different from each other. 



Possible strategies associated with the interpretation of the re- 
maining tables are not so clear-cut as was the case with Table 2. Strate- 
gies will vary with the situation and the variables being considered. Cer- 
tainly, because a higher income level was associated with r m K- s in c o- rpn r i - 
son to ffcrnlos, as wj 11 be shown in Table 4, fe-mlr training should not 
necessarily l*e di.se on tinned. However, an a.-, tutu counselor may- advise were 
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Table 1 



►£* 



FACTOR LEVELS AMD NUMBER OF OBSERVATIONS 





Factor 


Level 1 


Leve 1 2 


Level 3 


Level 4 


1 

X • 


Instructional 


Drafting (47) ^ 


Welding (41) 


Mechanics & 


Machinists (39) 




Program, Male 






Repairmen (120) 




2. 


Ins tructional 


Office Occupa- 


Cosmetology 


Health Occupa- 


- - 




Program, Female 


tions (106) 


(6) 


tions (52) 




• 


Sex 


Male (252) 


Female (159) 


— 


— 


4. 


Urban- Rural 


Urban (200) 


Rural (211) 




— 


5. 


Race 


White (371) 


Black (40) 


M 




6 . 


Relatedness of 


Congruent (209) 


Related (33) 


Unrelated (59) 


No Training Re- 




Training to 








quired (110) 




Occupation 










7. 


Occupational 


None (294) 


Change to 


Change to Un- 


— 




Mobility 




Related Jobs 


related Jobs 










(36) 


(81) 




3. 


Pos t-Atf'l’S 


None (296) 


Less than 3 


Less than 3 


1 Year or More 




Training 




Months Unre- 


Months Re lated 


College or 1 








lated to Occu- 


to Occupation 


Year or More 








pation (35) . 


(33) . More than 


College and 








More than 3 


3 Months was 


Other Training 








months was 


coded Level 6 


(26) 








coded Level 5 


(16). 










(5). 






9. 


Geographic 


None or Move- 


Movement at 


Other More 


-- 




Mobility 


ment to Adja- 


Least 2 


Distant 








cent County 


Counties from 


Movement (26) 








(363) 


Ponte but With- 







in State (22) 



Leve 1 5 




(continued) 
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Table 1 (Continued) 



r i 





Factor 


Level 1 


Leve 1 2 


Level 3 


Level 4 


Level 5 


10. 


Marital Status 


Married (280) 


Single 6c Other 
(131) 


— 


— 


— 


11. 


Level of Cduca - 
tional Attain- 
ment 


8 Years or 
Less (29) 


9“11 Years 
(56) 


12 Years 
(297) 


13-14 Years 
(29) 




12. 


2 

icr 


90 or Less 
(53) 


91 to 110 
(287) 


111 & Over 
(61) 


— 


-- 


13. 


Age in 1968^ 


Younger than 
20 (48) 


20 and Over 
(363) 




— 


** 


14. 


Hours of 

2 

Instruction 


300 to 699 
Hours (131) 


700 to 1099 
Hours (97) 


1100 to 149-9 
Hours (66) 


1500 to 1899 
Hours (27) 


1900 Hours and 
Over (90) 



■^Mumber of observations shown in parentheses. 



2 , 



tfhen variable was used as a covariate, it was entered into the equations as a continuous variable. 
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Table 2 
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MALE INSTRUCTIONAL PROGRAMS 



Level 

(Ranked by Adjusted Income) 


■ ■ ■ -■ u J * 

Unadjusted Mean Income 
(Dollars Per Quarter) 


Adjusted Mean Income 
(Dollars Per Quarter) 


Significance 
(Adjusted Income) 
.05 .01 


Leve 1 4 

Machinists 


1508 


1503 




Level 3 

Mechanics & Repairmen 


1440 


1518 




Level 1 

Drafting 


1577 


1536 


None 


Level 2 
Welding 


1533 


1564 





O 
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females to enroll in traditionally male programs on the basis of evi- 
dcnce presented in the table. The remaining tables will not be dis- 
cussed in terms of counseling ox' planning action but will only be 
analyzed in terms of significant differences in income. It is left 
to the reader to relate the findings to possible strategics. Perhaps 
more importantly, the authors intend to demonstrate a technique that 
can be replicated in specific educational systems by educational plan 
ners. 



Table 3 shows that female students trained in health occupa- 
tions had significantly higher incomes than those t-ained in office 
occupations. Health occupations included primarily training for 
"Certification occupations" such as licensed practical nurse and 
certified lab technician. 

It can be seen from Table 4 that males were significantly higher 
in income than females. Inis is certainly no startling finding, but it. 
is interesting to note the magnitude of the difference. Males earned 
approximately 70 percent more than females even with labor force par- 
ticipation and unemployment partially controlled by our method of income 
measurement in addition to covariatc control. Whether the income dis- 
parity is due to differences in productivity or to cultural barriers 
is an interesting question which lies beyond the scope of the present 
paper. 



Table 5 shows no significant income differences between former 
students with rural and urban residences. Urban students were defined 
as those students who attended high school in cities of 20,000 or more 
or, v?hcn this information was not available, who attended an AVTS school 
in a county containing a city of 25,000 or more. 

Table 6 shows almost identical earnings among blades and whites 
in the study population. Vocational education may have effectively 
reversed employment discrimination. The evidence presented here , albeit 
meager, is that the acquisition of occupational skills and attitudes may 
be an economic and social ameliorator of black disadvantagement in the 
labor market. 

Table 7 shows differences in income among the four levels of job 
relatedness to training. By comparing the occupation reported on the 
questionnaire with the type of instruction received by the student, it 
was possible to devise the four cell classification shown in Tables 1 
and 6. Level 1 included former students who worked at jobs directly 
matched to their training; Level 2 included former students who worked 
at jobs indirectly related to their training, c.g., an auto mechanic 
trained as a refrigeration mechanic; Level 3 included those with jobs 
unrelated to their training, e.g., secretary trained as a cosmetologist; 
Level 4 contained those with jobs that required no formal training; c.g. 
packager or inspector (garments). Although Level 1 was highest in in cor' 
as expected, it was significan tly different only from Level 4, as were 
Levels 2 and 3. This finding strong iy supports the economic justificati 
of job counseling as a necessary component of vocational education pro- 
grams . 



Table 3 



FEMALE INSTRUCTIONAL PROGRAMS 



Level 

(Ranked by Adjusted Income 


Unadjusted Mean Income 
(Dollars Per Quarter) 


Adjusted Mean Income 
(Dollars Per Quarter) 


Significance 
(Adjusted Income) 
.05 .01 


Level 1 

Office Occupations 


945 


843 


Level 3 


Level 2 

Cosmetology 


799 


946 




Level 3 

Health Occupations 


1138 


1 16^ 

• 


Level 1 




Table 4 



SEX 



Level 

(Pnn’/.ed bv Ad lusted Income) 


Unadjusted Mean Income 
(Dollars Per Quarter) 


Adjusted Mean Income 
(Dollars Per Quarter) 


Sigrif i.-'ince 
(Adjusted Income) 
.05 .01 


Level ? 








’ r i*h;i 1 e 


984 


908 


Le ve 1 1 


Levo’ 1 








; J : - 1 o 


1493 


1541 


Level 2 



C 



o 
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Table 5 



URBAN- RURAL RESIDENCE 



Level 

( Ranked by Adjusted Incone) 


Unadjusted Mean Income 
(Dollars per Quarter) 


Adjusted Mean Income 
(Dollars Per Quarter) 


Significance 
(Adjusted Income) 
.05 ,01 


Level 2 

v 1 p 1 


1271 


1281 


None 


Level I 


?, rbrm 


1323 


1321 






Table 6 



RACE 



bCVCl 

{ Vanned by Adjusted Income) 


Unadjusted Mean Income 
(Dollars Per Quarter) 


Adjusted Mean Income 
(Dollars Per Quarter) 


Significance 
(Adjusted Income) 

.05 .01 


bevel l 








/.'bite 


1325 


1296 


None 


bevel 2 








;>2 Oc 


1029 


1292 





O 
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Table 7 



RELATEDNESS OF TRAINING TO OCCUPATION 



Level 

(Ranked by Adjusted Income) 


Unadjusted Mean Income 
(Dollars Per (garter) 


Adjusted Mean Income 
(Dollars Per Quarter) 


Significance 
(Adjusted Income) 
.05 .01 


Level 4 

\'o Training Required 


1102 


1030 


Level 1,2,3 


Level 2 
.Related 


1450 


1311 


Level 4 


Level 3 

Unrelated 


1481 


1336 


Level 4 


Level 1 

Congruent 


1322 


1396 


Level 4 
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Table 8 rc-vonls that occupational, mobility was not related to 
j nc oiue . F row in f 01 tun lion on t h o qu c a t j onnn i re* i t wa s' dote rmi n o d 
whether the* former student ruado' no occupational change in 19 68-* -Level 
1, changed to a related job--Leve] 2, or changed to an unrelated job-- 
Level 3. The ore t foully , it. v:p.s expected that occupational change 
would be positively related to income as workers' respond to economic, 
inccnt i ves . 



Table 9 reveals differences in earnings among fonder studcnLs 
with different types of training experiences in addition to AVTS 
training. From the questionnaires the typo and duration of any addi- 
tional formal training or' education (including formal 0.1 T programs) 
was determined and compared with present occupation. Assignment was 
then made to one of the six levels shown in Table 8. It can be seen 
that Level 4 was significantly lower than Level 1 and Level 3, while 
there were no significant differences among the remaining levels 
(partially due to the small, number of observations in these latter 
catcgori s--see Table 1). Level 1 may have been significantly lower 
due in p trt to the inclusion in that category of fo inner' AVTS students 
who wcr< attending college part-time;, and consequently did not earn at 
their full potential. 

Table. 10 reveals significant differences among three levels' of 
geographic mobility. The address of the last public school attended 
prior to AVTS was obtained from AVTS records and compared with the 
address given on the questionnaire to determine, the three levels shown 
in Tabic 10. Level 3 was significantly higher in income than both 
Levels 1 and 2. This finding tends to support the proposition that 
economic incentive is associated with distant geographic movement. 



Table 11 reveals a significant difference in earning; between 
married persons and single (and other) persons with carried pel's ens 
being the higher. Actually the difference would probably have been 
more extreme among males if shown separately and opposite in direc- 
tion among females who tend to have lov.’cr rather than higher partici- 
pation rates when married. There is strong empirical eviden.ee from 
other sources to support the preceding, but the partial control of 
participation inherent to the potential inccvt concept forced the 
countervailing trends in the direction of an income advantage for 
married sub gee cs . 



Table 12 shows differences among the levels of prior education- 
al attainment. Level of prior educational attainment was obtained 
from AVTS entry records, and each stu lent was assigned to one of the 
four levels. The table reflect,*? generally who t one woo. Id expect to 
find; hi git school graduates we re s i go. [ fi ear i 1 y hi gh e r in earnings than, 
both high school drouo-.ts t Level 2) and grad-- school graduate*; and 
dropouts (Level 1 ) . Age in, i nc owe for Level -• wa s p Vo b a b ! y d e j - iv s s e d 
because some of the foc-vr 2 7 IS scudr.--.-t s lli this cniwory wore still 
attending c o 1 1 e _ o o a r : - t i : ■■ . 
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Table 8 



OCCUPATIONAL MOBILITY 



Leve 1 

(Ranged by Ad justed Incone) 


Unadjusted Mean Income 
(Dollars Per Quarter) 


Adjusted Mean Income 
(Dollars Per Quarter) 


Significance 
(Adjusted Income) 

.05 .01 


Level 2 

Change to Related Job 


1227 


1264 


None 


Level 3 

Change to Unrelated Job 


1329 


1293 




Level 1 

No Change 


1296 


1301 

4 
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Table 9 



POST-AVTS TRAINING 



Significance 



Level 

(Ranked by Adjusted Income) 


Unadjusted Mean Income 
(Dollars Per Quarter) 


Adjusted Mean Income 
(Dollars For Quarter) 


(Adjusted Income) 
.05 .01 


Level 4 

1 Year College & Other 
Training 


1167 


1050 


Level 1,3 


Level 1 

To Additional Training 


1246 


1281 


Level 4 


Level 3 

Less than 3 Months 
Related to Occupation 


1505 


1389 


Level 4 


Level 5 

Over 3 Months Unrelated 
to Occupation 


1529 


1393 




Level 6 

Over 3 Months Related 
to Occupation 


1598 


1402 




Level 2 

Less than 3 Months 
Related to Occupation 


145 1 


1456 





Table 10 



GEOGRAPHIC MOBILITY 



Level 

(Ranked by Adjusted Income) 


Unadjusted Mean Income 
(.Dollars D er Quarter) 


Adjusted Mean Income 
(Dollars Per Quarter) 


Signi ficance 
(Adjusted Income) 
.05 .01 


Level 2 

Movement Mi thin State 


1260 


1266 


Level 3 


Level 1 
Lone 


126$ 


1272 


Level 3 


Level 3 

Movement Out of State 


1715 


1652 


Level 2,1 
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Table 11 



MARITAL STATUS 



Level 

(Ranked by Adjusted Income) 


Unadjusted Mean Income 
(Dollars Per Quarter) 


Adjusted Mean Income 
(Dollars Per Quarter) 


Significance 
(Adjusted Income) 

.05 .01 


Level 2 








Single 


1159 


1217 


Leve 1 1 


Level 1 








Married 


1360 


1332 


Level 2 



c r; 







Table 12 





LEVEL Or EDUCATIONAL 


ATTAINMENT 










Significance 


Level 


Unadjusted Mean Income 


Adjusted Mean Income 


(Adjusted Income) 


(Ranked by Adjusted Income) 


(Dollar 1 -’ Per Quarter) 


(Dollars Per Quarter) 


.05 .01 


Level 2 








U-il Years 


1141 


1111 


Level 3 


Level 1 








S Yf.*ars or Less 


1314 


1133 


Level 3 


Level 4 








13-14 Y’ears 


1264 


1240 




Level 3 








12 Years 


1327 


1352 


Level 1 Level 3 




oz^ 



Table 13 



IQ 



Level 

(Ranked by Adjusted Income) 


Unadjusted Mean Income 
(Dollars Per Quarter) 


Adjusted Mean Income 
(Dollars Per Quarter) 


Significance 
(Adjusted Income) 
.03 .01 


Level 1 

90 or Less 


1200 


1244 




Level 2 

91 to 110 


1293 


1298 


None 


Level 3 

111 and Over 


1394 


1332 
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relationship. The lack of a significant relationship he\*e may have 
been due in pari not only to the typical difficulty of IQ men su ru- 
men t but the heterogeneity of measures that were relied upon. In 
about 25 percent of the cases, IQ scores (although from several dif- 
ferent tests) were available directly from high school records. For 
another 60 percent only the G component of the GATH test was avail- 
able and used as a proxy for IQ. For the remaining 15 percent of 
students who bad unkuovm IQ's, the mean IQ o£ 99 was assigned. 

Table 14 reveals no significant differences between the two 
age levels although the trend is in the expected direction of the 
young earning less than the old (and is significant at .10). 

Table 15 shows differences among levels of hours of instruction. 
Only two levels were significantly different; income for former stu- 
dents receiving from 300 to 699 hours of AVTS instruction was signifi- 
cant ly higher than those receiving 1,900 or more hours. Theoretically, 
hours of instruction should not be related to income, for the AVTS' 
program was designed to a] low students to proceed at their own pace 
(except in certification fields such as certain health occupations 
that required 2,150 hours, which dominated Level 5). Hypothe Lically , 
the student remained in training until entry level skill was acquired. 
11ms, students generally reached a common level of proficiency, and 
other factors being adjusted by the statistical model, one would ex- 
pect little difference in earnings. However, the heavy over-repre- 
sentation of female; s in the 1900-hour- and -over' category (80 out of 
the 90 subjects in the category were female) biased downward the 
estimate of adjusted mean income. The one significant relationship 
notwithstanding, meager evidence is lent to tbe proposition that the 
individual progression system wor’" d. 



Summary 

The purpose' of this paper has been to describe an internal 
comparison procedure developed by the authors to analyze the effects 
cf vari ous' student- related and prog ram- re 1 at ed charac t er i s t i.c s on 
potential income. The procedure was developed as an evaluative al- 
ternative to the specific rate of return (and benefit -cost ratio) 
approach on the one hand and the general, descriptive "follow-up" 
approach on the oLhcr. 



The main advantages of the internal comparison procedure lie 
in the st raigh t forward interpretation of the results, flexibility in 
kinds of comparisons that can be made, and, most of all, reasonably 
accurate income estimates. Ihose advantages stem primarily from the 
sample selection, a -/ell cont, oiled and conceptualized method of data 
collection (including questionnaire design, response rate, and reliane 
upon Social Security earnings records), selection of a dependent 
variable ''potent ini earned iuco.ee) tlu.i offers; control on unemployment, 
and labor force part i cipat ion , and use- of a statistical design that 
a! 1 ov.’ s c s t i ma t i on of i nd i v i d un 1 fact o r e f f . e i s i ncl cp l r d. -mt of co- 
variate influence;. 
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Table 14 
AGE IN 1968 



Level 

(Ranked by Adjusted Income 


Unadjusted Mean Income 
(Dollars Per Quarter) 


Adjusted Mean Income 
(Dollars Per Quarter) 


Significance 
(Adjusted Income) 
.05 .01 


Level 1 








Less than 20 


1043 


1181 


None 


Level 2 








20 and Over 


1330 


1311 





C/i 

CT 



f 

9 




Table 15 



HOURS OF INSTRUCTION 



Level 

(Ranked by Adjusted Income) 


Unadjusted Mean Income 
(Dollars Per Quarter) 


Adjusted Mean Income • 
(Dollars Per Quarter) 


Significance 
(Adjusted Income) 
. 05 01 


Level 5 

1900 Hours and Over 


1187 


1180 


Level 1 


Level 2 

700 to 1099 Hours 


1300 


1270 




Level 3 

1100 to 1499 Hours 


1310 


1282 




Level 1 

300 to 699 Hours 


1330 


1379 


Level 5 


Level 4 

1500 to 1899 Hours 


1451 


1409 





A note of caul ion must; now be extended to the reader regarding 
the interpretation of the various income hierarchies. Although the 
relative income position for a given student characteristic or pro- 
gram characteristic may reflect endogenous training efficiencies, it 
may also be an exogenous effect of the supply and demand functions 
for the occupations involved. ^ ThaL is to say that an efficient 
office occupations program may attract able and willing candidates 
who become proficient secretaries but at low wages due to a local 
labor market glut. The converse may also be true. Then too, there 
are institutional barriers against entry and progression in many 
occupations, although the fact remains that the treatment of adjusted 
mean income is a valid technique for estimating ordinal income dif- 
ferences among specified categories of vocational students in subse- 
quent labor force experience. 

The point to be made is that a program evaluation such as the 
one reported upon here should be integrated into a larger planning 
system containing a wide spectrum of knowledge about the structure 
of the labor markets to be served. This method allows the rigorous 
and systematic analysis of income in association with program and 
student characteristics which may serve as a basis for m.;re exten- 
sive occupational studies vis-a-vis the labor market. 
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8. The questionnaire, its design and pretest, and the payment proce- 

dure are all treated in detail in R. L. Bowlby and W. R. Schriver, 
The Effects of Vocational Education on Labor Force Experience in 
Tennessee (Memphis: Memphis State University, Center for Manpower 

t Studies, February 3971). 

9. See Michael Borus, "Response Error in Survey Reports of Earnings 

i Information," Journal of American Statistical Association , Sep- 

tember 1966 . 

; 10. This assumption, incidentally, is used in computing unemployment 

l benefits in Tennessee and other states. 

I 11. Since rank of income rather than its absolute value is critical in 

i the technique to be employed, further support is lent to the "po- 

tential income" concept. An analysis similar to the one reported 
upon here was performed by the authors using the more conventional 
j average income rather than income potential. The results were 

- generally similar with regard to rank but much larger variances 

were encouiiLei'ed primarily due to differences in rates of par tic i- 
i pation and unemployment, particularly among females. 
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